Information processing device, system, information processing method, and program

ABSTRACT

There is provided an information processing device including an action history acquiring unit configured to acquire action history information on a user, the action history information being accumulated in a predetermined time frame, an attribute score calculating unit configured to calculate an attribute score of the user for one or more attributes in an attribute group, the attribute score being based on the action history information, and an object generating unit configured to generate an object on the basis of the attribute score, the object representing the user.

CROSS-REFERENCE TO RELATED APPLICATIONS

This document is a continuation application of and is based upon andclaims the benefit of priority under 35 U.S.C. § 120 from U.S. Ser. No.14/428,069, filed Mar. 13, 2015, herein incorporated by reference, whichis a National Stage Application of International Application No.PCT/JP2013/074152, filed Sep. 6, 2013. The present document alsoincorporates by reference the entire contents of Japanese prioritydocument, 2012-256132 filed in Japan on Nov. 22, 2012.

TECHNICAL FIELD

The present disclosure relates an information processing device, asystem, an information processing method, and a program.

BACKGROUND ART

For example, when users have conversations with each other in virtualspace such as online games and community sites, avatars representingusers are frequently displayed along with text showing their comments.Avatars provide, for example, visual images to the presence of users invirtual space to approximate the presence of the users in the virtualspace to the presence in real space, thereby smoothing communication ofthe users in the virtual space with each other.

A technique has also been devised for associating an actual state of auser with such avatar display. For example, Patent Literature 1describes a technique of changing a facial expression and movement of anavatar in a manner that an emotion corresponding to a change inbiological information on a user and a facial expression of a user isexpressed. In addition, Patent Literature 2 describes a technique ofexpressing intimacy of each user with another user and an activity stateof another user in terms of the display position of an objectrepresenting each user.

CITATION LIST Patent Literature

Patent Literature 1: JP 2002-190034A

Patent Literature 2: JP 2010-134802A

SUMMARY OF INVENTION Technical Problem

However, these techniques certainly change facial expressions andmovement of avatars in accordance with the states of users, but avatarsas such are freely set by users. Consequently, an avatar may beconsiderably different from the actual personality of a user in somesituations. For example, when a middle-aged male user sets a girl as hisavatar, the state of the user can be certainly expressed from a changein the facial expression, but the avatar as such is still different fromthe actual personality of the user.

Communication in virtual space allows users to be free from the usersthemselves in the actual world in some scenes. However, widespread useof social networking services (SNSs) or social media have frequentlylinked the presence in virtual space with the presence in the actualworld in recent years. More natural and smooth communication can beexpected in such a case, if avatars represent the actual personalitiesof users.

Accordingly, the present disclosure provides a novel and improvedinformation processing device, system, information processing method,and program that allow an object reflecting the personality of a user torepresent the user.

Solution to Problem

According to the present disclosure, there is provided a serverincluding an action history acquiring unit configured to acquire actionhistory information on a user, the action history information beingaccumulated in a predetermined time frame, an attribute scorecalculating unit configured to calculate an attribute score of the userfor one or more attributes in an attribute group, the attribute scorebeing based on the action history information, and an object generatingunit configured to generate an object on the basis of the attributescore, the object representing the user.

In addition, according to the present disclosure, there is provided aclient including a sensing unit configured to sense an action of a user,a communication unit configured to transmit a result of the sensing to aserver, and to receive information on an object from the server, theobject being generated on the basis of an attribute score calculated forone or more attributes in an attribute group on the basis of actionhistory information on the user accumulated in a predetermined timeframe and representing the user, the action history information beinggenerated on the basis of information including the result of thesensing, and a display control unit configured to cause a display unitto display the object.

In addition, according to the present disclosure, there is provided asystem including a client, and a server. The client includes a sensingunit configured to sense an action of a user, a communication unitconfigured to transmit a result of the sensing to the server, and toreceive information on an object from the server, the objectrepresenting the user, and a display control unit configured to cause adisplay unit to display the object. The server includes an actionhistory acquiring unit configured to acquire action history informationon the user, the action history information being accumulated in apredetermined time frame and being generated on the basis of informationincluding the result of the sensing, an attribute score calculating unitconfigured to calculate an attribute score of the user for one or moreattributes in an attribute group, the attribute score being based on theaction history information, and an object generating unit configured togenerate the object on the basis of the attribute score.

In addition, according to the present disclosure, there is provided aninformation processing method including acquiring action historyinformation on a user, the action history information being accumulatedin a predetermined time frame, calculating an attribute score of theuser for one or more attributes in an attribute group, the attributescore being based on the action history information, and generating anobject on the basis of the attribute score, the object representing theuser.

In addition, according to the present disclosure, there is provided aprogram for causing a computer to execute a function of acquiring actionhistory information on a user, the action history information beingaccumulated in a predetermined time frame, a function of calculating anattribute score of the user for one or more attributes in an attributegroup, the attribute score being based on the action historyinformation, and a function of generating an object on the basis of theattribute score, the object representing the user.

It can be said that a life of a user in a predetermined time frame isreflected on action history information on the user accumulated in thetime frame. Calculating an attribute score for one or more attributes inan attribute group from the action history information offers anindicator that indicates the personality of the user. If an object isgenerated on the basis of the indicator or the attribute score, thepersonality of the user is reflected on the generated object.

Advantageous Effects of Invention

According to the present disclosure as described above, it is possiblefor an object that reflects the personality of a user to represent theuser.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating a schematic functionalconfiguration of a system according to a first embodiment of the presentdisclosure

FIG. 2 is a diagram illustrating an example in which an object isdisplayed in the system according to the first embodiment of the presentdisclosure.

FIG. 3 is a flowchart illustrating an example of a process forimplementing display as illustrated in FIG. 2.

FIG. 4 is a diagram illustrating an example of data used in the firstembodiment of the present disclosure.

FIG. 5 is a diagram illustrating a first example in which an objectgenerating condition is set in the first embodiment of the presentdisclosure.

FIG. 6 is a diagram illustrating a second example in which an objectgenerating condition is set in the first embodiment of the presentdisclosure.

FIG. 7 is a diagram illustrating a third example in which an objectgenerating condition is set in the first embodiment of the presentdisclosure.

FIG. 8 is a diagram illustrating a modified example of the example ofFIG. 7.

FIG. 9 is a diagram illustrating an example of setting an object step bystep in the first embodiment of the present disclosure.

FIG. 10 is a block diagram illustrating a first modified example of afunctional configuration in the first embodiment of the presentdisclosure.

FIG. 11 is a block diagram illustrating a second modified example of thefunctional configuration in the first embodiment of the presentdisclosure.

FIG. 12 is a diagram illustrating a first display example in a secondembodiment of the present disclosure.

FIG. 13 is a diagram illustrating a second display example in the secondembodiment of the present disclosure.

FIG. 14 is a block diagram illustrating a schematic functionalconfiguration of a system according to a third embodiment of the presentdisclosure.

FIG. 15 is a diagram illustrating an example of data used in the thirdembodiment of the present disclosure.

FIG. 16 is a flowchart illustrating an example of a process in the thirdembodiment of the present disclosure.

FIG. 17 is a diagram illustrating a first display example in the thirdembodiment of the present disclosure.

FIG. 18 is a diagram illustrating a second display example in the thirdembodiment of the present disclosure.

FIG. 19 is a block diagram illustrating a schematic functionalconfiguration of a system according to a modified example of the thirdembodiment of the present disclosure.

FIG. 20 is a flowchart illustrating the modified example of the thirdembodiment of the present disclosure.

FIG. 21 is a diagram illustrating a first display example in a fourthembodiment of the present disclosure.

FIG. 22 is a diagram illustrating an example of a process of sharingdisplay of an object in friend registration between users in the fourthembodiment of the present disclosure.

FIG. 23 is a diagram illustrating a second display example in the fourthembodiment of the present disclosure.

FIG. 24 is a flowchart illustrating an example of a process forimplementing display as illustrated in FIG. 23.

FIG. 25 is a block diagram for describing a hardware configuration of aninformation processing device.

DESCRIPTION OF EMBODIMENTS

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the appended drawings. Note that,in the present description and the drawings, elements that havesubstantially the same function and structure are denoted with the samereference signs, and repeated explanation is omitted.

The description will be now made in the following order.

-   1. First Embodiment    -   1-1. Functional Configuration    -   1-2. Example of Process    -   1-3. Example of Data    -   1-4. Example of Object Generating Condition    -   1-5. Example of Setting Object Step by Step    -   1-6. Modified Examples for Functional Configuration-   2. Second Embodiment-   3. Third Embodiment    -   3-1. Functional Configuration    -   3-2. Example of Process    -   3-3. Display Example    -   3-4. Modified Example-   4. Fourth Embodiment-   5. Hardware Configuration-   6. Supplement

1. First Embodiment

First of all, a first embodiment of the present disclosure will bedescribed with reference to FIGS. 1 to 11.

(1-1. Functional Configuration)

FIG. 1 is a block diagram illustrating a schematic functionalconfiguration of a system according to a first embodiment of the presentdisclosure. FIG. 1 illustrates that a system 10 includes a client 100and a server 150. The client 100 and the server 150 are connected toeach other via various wired or wireless networks, and communicate witheach other as needed. The configuration of each of the client 100 andthe server 150 will be further described below.

(Client)

The client 100 includes a sensing unit 102, an input unit 104, a displaycontrol unit 106, a display unit 108, and a communication unit 110. Theclient 100 is implemented as a variety of information processing devicesused by a user such as mobile phones (smartphones), various personalcomputers (PCs), media players, and game consoles. The informationprocessing devices are implemented, for example, as a hardwareconfiguration as discussed below.

Here, the client 100 may be implemented as a single device or aplurality of devices. For example, the sensing unit 102 is desired to beimplemented as a device such as a mobile phone (smartphone) carried by ause for sensing an action of the user. Meanwhile, the input unit 104,the display control unit 106, and the display unit 108 do notnecessarily have to be carried by a user, so that the input unit 104,the display control unit 106, and the display unit 108 may beimplemented as the same device as the sensing unit 102, or a devicedifferent from the sensing unit 102 including a stationary device suchas a desktop PC. Each functional configuration of the client 100 will bedescribed below.

The sensing unit 102 senses an action of a user who uses the client 100.The sensing unit 102 is implemented as a variety of sensor such asacceleration sensors, gyro sensors, geomagnetic sensors, optical sensorsand audio sensors, and/or global positioning system (GPS) receivers, andsenses the position, activity state or the like of a user. The sensingunit 102 transmits a result of the sensing to the server 150 via thecommunication unit 110.

The input unit 104 receives an input of a user regarding a filteringcondition for generating an object in the server 150. As discussedbelow, the server 150 has a function of selecting a range of actionhistories to be acquired, or an attribute score to be emphasized forgenerating an object that represents a user in some cases. In this case,a user can make his or her desire reflected on the generation of anobject to some extent by inputting information on the selection, forexample, via the input unit 104. The input unit 104 is implemented as aninput device such as a touch panel, a keyboard and a mouse, andtransmits the received input to the sever 150 via the communication unit110.

The display control unit 106 receives information on the objectgenerated in the server 150 via the communication unit 110, and causesthe display unit 108 to display the object. The object is an object suchas an avatar that represents a user. An object displayed here using thereceived information may include an object generated for a user whoseaction is sensed by the sensing unit 102, an object generated foranother user, or both of the objects. The display control unit 106 maydisplay an object alone, or may display an object in a screen foranother application or the like. In addition, the display control unit106 superimposes an object on an image of the corresponding user (suchas a captured image provided from an augmented reality (AR) applicationor an image of the real space seen through a see-through display unit108). The display control unit 106 is implemented, for example, by acentral processing unit (CPU) operating in accordance with a programstored in a memory.

The display unit 108 displays a variety of information for a user inaccordance with control exerted by the display control unit 106. Asdescribed for the display control unit 106, information displayed on thedisplay unit 108 includes an object that represents a user. The displayunit 108 is implemented, for example, as a variety of displays. Thedisplay may be, for example, a flat display or a head mounted display.In addition, the display may be, for example, a non-transmissive displayor a transmissive display.

The communication unit 110 transmits and receives a variety ofinformation exchanged between the client 100 and the server 150. Thecommunication unit 110 is implemented, for example, as a variety ofcommunication interfaces that are connected to a network.

(Server)

The server 150 includes an action recognizing unit 152, an actionhistory DB 154, an action history acquiring unit 156, an attribute scorecalculating unit 158, an attribute DB 160, an object generating unit162, an object DB 164, a user DB 166, and a communication unit 168. Theserver 150 may further include one or both of a time frame selectingunit 170 and an attribute selecting unit 172. The server 150 may beimplemented as a single information processing device or a plurality ofinformation processing devices that are connected to each other viavarious wired or wireless networks and operate in cooperation with eachother. The information processing devices are implemented, for example,as a hardware configuration as discussed below. Each functionalconfiguration will be described below. Additionally, each unit otherthan the DBs and the communication unit is implemented, for example, bya CPU operating in accordance with a program stored in a memory. The DBsare implemented, for example, as storage devices.

The action recognizing unit 152 recognizes an action of a user of theclient 100 on the basis of a result of sensing received from the sensingunit 102 of the client 100 via the communication unit 168, and stores aresult of the recognition in the action history DB 154. The actionrecognizing unit 152 may further acquire other information from anotherserver and the like, and recognize an action of the user further on thebasis of the information. The other information may be, for example, apurchase log in a store, a history indicating a terminal installed at acertain place is operated, or the like. The action recognizing unit 152may further use registered information including the address andworkplace of a user for recognizing an action. Additionally, techniquesof recognizing actions are introduced in a large number of documentssuch as JP 2012-8771A in detail, and the action recognizing unit 152uses these techniques as required to recognize an action of a user.

Results of recognition by the action recognizing unit 152 areaccumulated in the action history DB 154 as an action history of a user.Information accumulated in the action history DB 154 may be, forexample, a position history, purchase history, operation history, andthe like of a user, or an action pattern history, action type history,and the like that reflect a result of recognition by the actionrecognizing unit 152. For example, the following may be accumulated asan example of such unlimited information. Whether a terminal device isbeing charged or operated. Whether a user is resting, sitting, walking,running, or jumping. Whether a user is moving, and the position. Whethera user is in a train, in a car, or on an elevator. Whether a user isworking or shopping. An action of a user estimated from a tone in a textlog input by the user. It is possible to identify how a user acted atcertain time in the past, if that information accumulated in the actionhistory DB 154 is referenced.

The action history acquiring unit 156 acquires action historyinformation on a user accumulated in a predetermined time frame from theaction history DB 154. The action history acquiring unit 156 may specifythe last certain time frame (e.g. one year in the past) or all the timeframes in which action history information exists (i.e. from time when auser began to use a service for acquiring action histories to thepresent time) as the predetermined time frame. When the time frameselecting unit 170 is additionally installed and the time frameselecting unit 170 has selected a time frame, the action historyacquiring unit 156 acquires action history information for the selectedtime frame. When no time frame has been selected, the action historyacquiring unit 156 acquires action history information in the same wayas the action history acquiring unit 156 does when the time frameselecting unit 170 is not installed.

The attribute score calculating unit 158 calculates an attribute scorefor one or more attributes in an attribute group on the basis of theaction history information on a user acquired by the action historyacquiring unit 156. The attributes may indicate the personality of auser, and relate to, for example, work, shopping, eating or the like.The attributes are registered in the attribute DB 160 in advance as anattribute group. The attribute score calculating unit 158 may calculateattribute scores for all or a part of the attributes in the attributegroup. When attribute scores are calculated for a plurality ofattributes, the attribute score calculating unit 158 may normalize therespective scores to allow the magnitudes of the scores to be comparedbetween the different attributes. In addition, the attribute scorecalculating unit 158 may temporarily store the calculated attributescores in the attribute DB 160 in association with a user, and regularlyupdate the attribute scores.

When the attribute selecting unit 172 is additionally installed,selection by the attribute selecting unit 172 decides an attribute scoreto be emphasized for the object generating unit 162 discussed below togenerate an object. In this case, the attribute score calculating unit158 may calculate, for example, an attribute score for only theattribute selected by the attribute selecting unit 172, or may weightthe selected attribute to calculate an attribute score. Alternatively,the attribute score calculating unit 158 calculates attribute scores forone or more attributes in an attribute group irrespective of selectionby the attribute selecting unit 172 and stores the calculated attributescores in the attribute DB 160, and then the attribute score calculatingunit 158 may perform re-computation such as weighting in reading out theattribute scores stored in accordance with the selection by theattribute selecting unit 172. Additionally, an attribute and anattribute score are related to the generation of an object discussedbelow, so that those specific examples will be described along with anexample of an object.

The attribute DB 160 stores information on an attribute score calculatedby the attribute score calculating unit 158. For example, the attributeDB 160 stores information for defining an attribute group for which anattribute score is calculated. In addition, an attribute scorecalculated by the attribute score calculating unit 158 may be stored inthe attribute DB 160 in association with a user, and may be regularlyupdated by the attribute score calculating unit 158. Definitioninformation on each attribute included in an attribute group includes,for example, information for defining a relationship between an actionhistory and an attribute score. For example, for an attribute “work,” arule that “an attribute score is added in accordance with a time forwhich a user has been at a workplace” may be defined.

Additionally, as discussed below, when an object is generated on thebasis of an attribute score, information in the object DB 164 isreferenced. Definition information on an attribute stored in theattribute DB 160 thus corresponds to information on an object stored inthe object DB 164. For example, when an attribute “work” is defined inthe attribute DB 160, an object to be selected in accordance with anattribute score for “work” is defined in the object DB 164.

The object generating unit 162 generates an object that represents auser, on the basis of an attribute score provided from the attributescore calculating unit 158. The object is, for example, an image thatrepresents a user whose action history information is provided and isdisplayed for the user and/or another user. For example, when an objectis an image of a specific object (such as a human, an animal, and arobot), the object can also be regarded as an avatar (incarnation) of auser. An object may also be an abstract image such as a figure. Even inthis case, the object represents a user with its shape, size, color, andthe like. Additionally, specific examples of objects will be discussedbelow. The object generating unit 162 transmits the generated object tothe client 100 via the communication unit, and the transmitted object isused for the display control unit 106 to cause the display unit 108 toperform display. Furthermore, the object generating unit 162 may storethe generated object in the user DB 166 in association with a user, andthen read out the object when the object is requested to be providedagain.

Here, the object generating unit 162 references information registeredin the object DB 164 in advance, and generates an object on the basis ofan attribute score. More specifically, the object generating unit 162uses an attribute score to search for information registered in theobject DB 164, and extracts information on an object that is appropriatefor representing a user. For example, when the attribute scorecalculating unit 158 calculates attribute scores for a plurality ofattributes, the object generating unit 162 may extract information on anobject set for an attribute having the highest attribute score.Alternatively, the object generating unit 162 may extract information onan object set for each of attributes, and combine them in accordancewith the respective attribute scores to generate an object.

Furthermore, the object generating unit 162 may reference registeredinformation on a user stored in the user DB 166 to generate an object.In this case, the object generating unit 162 may select an appropriateobject from a plurality of objects prepared for the same attributescores, in accordance with the sex, age, occupation, and the like of auser. For example, generated objects having even the same attribute“work” may be different in accordance with whether users are male orfemale, whether user are young or old, whether users are office workersor factory workers, or the like. Referencing information on a user togenerate an object in this way allows the object to more appropriatelyrepresent the personality of the user. Additionally, when an object isan abstract image or an image of a specific object unrelated to anattribute such as sex and age, the object generating unit 162 does notnecessarily have to reference the user DB 166. It may be possible toallow a user to freely set, for example, the sex and age represented byan object.

The object DB 164 stores information on an object, the information beingused for the object generating unit 162 to generate an object. An objectis set, for example, in accordance with an attribute defined in theattribute DB 160. For example, when an attribute “work” is defined inthe attribute DB 160, the object DB 164 stores information on at leastone object corresponding to the attribute “work.” Furthermore, aplurality of objects may be set in accordance with attribute scores. Forexample, objects may be set at a plurality of steps in accordance with alow attribute score, a middle attribute score, a high attribute score,or the like for an attribute “work,” which can indicate how hard theuser works. The object DB 164 may store data for each object, the dataallowing an object to be displayed at a variety of postures and in avariety of sizes. In this case, the object generating unit 162, or thedisplay control unit 106 of the client 100 decides the posture and sizeof an object to be displayed.

The user DB 166 stores information on a user. Examples of information ona user may include registered information such as a user ID, sex, age,an address, an occupation, and a workplace. As described above,registered information on a user stored in the user DB 166 may also beused for the object generating unit 162 to generate an object.Registered information may be referenced by a variety of units of theserver 150 such as the action recognizing unit 152 in addition to theobject generating unit 162. In addition, the user DB 166 may storeinformation on an object generated by the object generating unit 162 inassociation with a user, and the stored information may be read out whenthe object is requested to be displayed.

The communication unit 168 transmits and receives a variety ofinformation exchanged between the server 150 and the client 100. Thecommunication unit 168 is implemented, for example, as a variety ofcommunication interfaces that are connected to a network.

The time frame selecting unit 170 is additionally installed. The timeframe selecting unit 170 selects a time frame to be emphasized for theobject selecting unit 162 to generate an object, on the basis of theinformation received, via the communication unit 168, from the inputunit 104, which has acquired an operation of a user in the client 100. Atime frame may be selected, for example, on the basis of a cyclic timeframe such as “summer,” “weekday,” “weekend,” “daytime,” “free time,”and “time at home,” or a non-cyclic time frame such as “until 10 yearsago,” “for a recent year,” and “ten years later.” When the time frameselecting unit 170 selects a time frame, the action history acquiringunit 156 may, for example, acquire action history information only inthe selected time frame. Alternatively, the attribute score calculatingunit 158 may weight the action history information in the selected timeframe more than action history information in the other time frames, andcalculate an attribute score.

Additionally, when a future time frame is selected, the action historyacquiring unit 156, for example, acquires relatively near-past actionhistory information on a user and the attribute score calculating unit158 calculates an estimated value of an attribute score in the selectedfuture time frame for the user, who continues the same action as theaction in the action history. In this case, for example, an objectgenerated through the selection of a future time frame for a user whohas not recently exercised very much may be an object of an overweightperson. The time frame selecting unit 170 can be one of the conditionsetting units which set a generating condition of an object in that thetime frame selecting unit 170 sets a condition for a time frame in whichaction history information or a source of an attribute score isacquired.

The attribute selecting unit 172 is also additionally installed. Theattribute selecting unit 172 selects an attribute to be emphasized forthe object generating unit 162 to generate an object, on the basis ofthe information received, via the communication unit 168, from the inputunit 104, which has acquired an operation of a user in the client 100.For example, when the attribute selecting unit 172 selects one or moreattributes from an attribute group defined in the attribute DB 160, theattribute score calculating unit 158 may calculate attribute scores onlyfor the selected attributes (the other attribute scores are 0), or mayweight attribute scores for the selected attributes more than the otherattribute scores. Alternatively, when the attribute score calculatingunit 158 has already calculated and stored attribute scores in theattribute DB 160, weights for the attribute scores for the selectedattributes among the attribute scores read out for generating an objectmay be re-computed.

Here, the number of selectable attribute scores may be set in advance.Alternatively, attributes may be selected in accordance with a patternset in advance. For example, when attributes are selected in accordancewith a pattern “daily action,” one or more attributes relating to“work,” “way to spend time at home,” “way to move,” and the like areselected. In addition, the selection of an attribute by the attributeselecting unit 172 and the selection of a time frame by the time frameselecting unit 170 may influence each other. For example, when the timeframe selecting unit 170 selects a time frame “weekend,” the attributeselecting unit 172 may select an attribute relating to an action onweekends such as “place for shopping,” and “way to spend a leisuretime.” In addition, for example, when the attribute selecting unit 172selects an attribute “work,” the time frame selecting unit 170 mayselect a time frame “weekday,” in which the “work” is probably carriedout. The attribute selecting unit 172 can also be one of the conditionsetting units which set a generating condition of an object in that theattribute selecting unit 172 selects an attribute score used forgenerating an object.

The time frame selecting unit 170 and the attribute selecting unit 172,which are condition setting units, set a generating condition of anobject in accordance with an operation of a user in the presentembodiment. This allows a user to select which attribute in which timeframe is reflected by an object representing the user himself orherself. In this way, a user can play the user himself or herself tosome extent “in a way he or she would like to show.” For example, even auser who is busy in work on weekdays can select a time frame “weekend”via the time frame selecting unit 170 to generate an object thatrepresents “the sporting user,” as long as the user enjoys sports onweekends. However, a user is not able to create the user himself orherself “in a way he or she would like to show” beyond the rangeindicated by an action history. For example, unless a user plays anysports on weekdays or weekends, the user is unable to generate an objectthat represents “the sporting user” in any way. In this way, even if auser is allowed to set a generating condition of an object, an objectgenerated by the object generating unit 162 reflects the personality ofthe user more or less. Needless to say, it may also be possible withoutany condition setting unit to generate an object that more realisticallyreflects the personality of a user.

Meanwhile, as a modified example of the present embodiment, the timeframe selecting unit 170 and the attribute selecting unit 172, which arecondition setting units, may set a generating condition in accordancewith a situation in which an object generated by the object generatingunit 162 is displayed. For example, the condition setting unit may set agenerating condition of an object in accordance with an attribute of acommunity site in which the object is displayed. For example, when anobject is displayed in a community site a theme of which is sports, theattribute selecting unit 172 may automatically select an attribute scorerelating to “sports.” In addition, for example, when an object isdisplayed a community site for a school reunion, the time frameselecting unit 170 may automatically select a time frame in which a userwas a student at school. This allows objects matching with theproperties of communication places in virtual space to be displayed ateach place.

The schematic functional configuration of the system according to thefirst embodiment of the present disclosure has been described so far.Next, specific examples will be described for processes for displayingan object and generating an object, and data used therefor in thesystem.

(1-2. Example of Process)

FIG. 2 is a diagram illustrating an example in which an object isdisplayed in the system according to the first embodiment of the presentdisclosure. FIG. 2 illustrates a situation in which a user A has aconversation with a user B in virtual space. Avatars 1101 and dialogues1103 are displayed on a screen 1100. Here, the avatars 1101 include anavatar 1101 a of the user A and an avatar 1101 b of the user B, whilethe dialogues 1103 include a dialogue 1103 a of the user A and adialogue 1103 b of the user B.

Here, the avatars 1101 are objects generated by the object generatingunit 162 of the server 150. The avatar 1101 a of the user A is generatedon the basis of an attribute score for “work,” and takes a form of auser who is in a suit and has a bag. This allows the conversationpartner or user B to recognize that the user A is a person who chieflyworks at a job.

Meanwhile, the avatar 1101 b of the user B is generated on the basis ofan attribute score for “housework,” and takes a form of a user who iscooking at home. This allows the user A to recognize that the user B isa person who chiefly does housework. Thus, the conversation between bothusers easily has topics such as “your work looks very tough” and“housework also looks very hard,” so that the conversation is expectedto be more natural and smooth.

FIG. 3 is a flowchart illustrating an example of a process forimplementing display as illustrated in FIG. 2. First of all, theattribute score calculating unit 158 regularly updates an attributescore of a user stored in the attribute DB 160 on the basis of an actionhistory acquired by the action history acquiring unit 156 in the server150 (step S101). Here, when the activation of an application, forexample, as illustrated in FIG. 2 or the like requests an object to bedisplayed (step S103), a process for generating an object is executed inthe server 150.

First of all, if the attribute selecting unit 172 selects some attribute(step S105), the attribute score calculating unit 158 selects anattribute score in accordance with the selection before reading out theattribute scores stored in the attribute DB 160 (step S107).Additionally, the selection of an attribute here may be based on, forexample, an operation of a user and a situation in which an object isdisplayed (a situation in which a conversation as illustrated in FIG. 2is made). When no attribute is selected, all of the calculated attributescores are used.

Next, the object generating unit 162 generates an object on the basis ofthe attribute score read out from the attribute DB 160 (step S109). Theobject generating unit 162 then transmits information on the object tothe client 100 via the communication unit 168 (step S111). At that time,the object generating unit 162 may transmit the information on theobject as part of data for displaying, for example, the screen 1100illustrated in FIG. 2. An image including an object that represents auser is done in the client 100 through the above-described processes.

(1-3. Example of Data)

FIG. 4 is a diagram illustrating an example of data used in the firstembodiment of the present disclosure. The illustrated example shows anexample of data used for generating objects for six users A to F. Eachitem of the data will be described, and “sex” and “occupation” areregistered information on the users and stored in the user DB 166, forexample. “Workplace” and “home” are attributes set for positionalhistories of the users, and attribute scores are calculated inaccordance with the length of a time for which the users have stayed atthe respective places. “Sitting,” “walking,” “running,” “eating,” and“shopping” are attributes set for action states of the users, andattribute scores are calculated in accordance with the length of a timeof the users for the respective actions. The respective attributionscores are normalized in the illustrated example, and it is possible tocompare the attribution scores with each other. Meanwhile, “departmentstore,” “supermarket,” and “bookstore” are attributes into which anattribute “shopping” is further subdivided, and attribute scores arecalculated in accordance with how many times the users have done theirshopping at each type of store, or how much money the users have spent.As this example of “shopping” shows, an attribute may have ahierarchical structure. These attribute scores are calculated by theattribute score calculating unit 158 on the basis of action histories ofthe users.

The object generating unit 162 generates objects that represent theusers, on the basis of data as described above. When no generatingcondition is set, the object generating unit 162 may reference all ofthe calculated attribute scores to generate objects. In this case, forexample, the object generating unit 162 compares the attribute scoresfor the respective attributes to generate an object for the highestattribute.

For example, “workplace” has the highest attribute score for the user Aand the user B. Accordingly, the object generating unit 162 selectsinformation on an object corresponding to the attribute “workplace” frominformation on objects stored in the object DB 164. Furthermore, whenseveral pieces of information on the object have been prepared inaccordance with sex, occupation, and the like, the object generatingunit 162 selects information on an object that matches with the sex andoccupation of the user A and the user B, which namely means an objectthat matches with a male office worker. As a result of these processes,for example, an avatar 1101 c of a man who is in a suit and has a bag isgenerated as an object. Here, for example, if the user A and the user Bare farmers by occupation and information on an object correspondingthereto is stored in the DB 164, another avatar of a man who has a strawhat on and has a hoe may, for example, be generated.

In the same way, although “workplace” has the highest attribute scorefor the user C and the user D, the object generating unit 162 generates,as an object, an avatar 1101 d of a woman who is in a suit because theuser C and the user D are female. Meanwhile, “home” has the highestattribute score for the user E and the user F. Accordingly, the objectgenerating unit 162 selects information on an object corresponding tothe attribute “home” from information on objects stored in the object DB164. In addition, since the user E and the user F are female, the objectgenerating unit 162 generates, as an object, an avatar 1101 e of a womanwho is cooking at home.

Additionally, although the object generating unit 162 generates anobject on the basis of an attribute that has the highest attribute scorein the example, an embodiment of the present disclosure is not limitedto such an example. For example, the object generating unit 162 mayacquire information on objects corresponding to a plurality ofattributes that have relatively high attribute scores from the object DB164, and generate an object by combining the acquired information inaccordance with the respective attribute scores.

For example, the users A to D are common in that “workplace” has thehighest attribute scores, but the users A to D are different in that“walking” has relatively high attribute scores for the user B and theuser C, while “walking” has relatively low attribute scores for the userA and the user D. For example, the object generating unit 162 maygenerate, as objects, an avatar of a man or a woman who is walking in asuit for the user B and the user C, and an avatar of a man or a womanwho is sitting in a suit for the user A and the user D, in order toreflect that difference on the objects.

In this way, generating an object on the basis of attribute scores for aplurality of attributes allows an attribute that matches with a user thebest to be extracted and allows an object that corresponds to theattribute to be generated. Meanwhile, for example, when a user is anoffice worker, there is possibility that another feature such as afeature “enjoying sports in his or her free time” is hidden, because“workplace” has a higher attribute score, which is calculated on thebasis of a stay time. In that case, the time frame selecting unit 170and the attribute selecting unit 172, which are additionally installed,set a generating condition of an object, so that it becomes possible togenerate an object that, for example, reflects the individuality of auser more. An example will be further described below in which an objectis generated in accordance with such a generating condition.

(1-4. Example of Object Generating Condition)

FIG. 5 is a diagram illustrating a first example in which an objectgenerating condition is set in the first embodiment of the presentdisclosure. A generating condition that can be also referred to as“exercise filter” is set in the illustrated example in order to generatean object on the basis of data as illustrated in FIG. 4. Morespecifically, the attribute selecting unit 172 selects attribute scoresfor “sitting,” “walking,” and “running,” which relate to exercisesituations of the users, as attribute scores to be emphasized forgenerating an object.

In this case, the object generating unit 162 generates an object byemphasizing the selected attribute score. Thus, an avatar 1101 f of aplump man is generated as an object for the user A in the illustratedexample, who has a high attribute score for “sitting,” and is estimatedto frequently act with low calorie consumption. Meanwhile, an avatar1101 g of a slim man is generated as an object for the user B, who hasrelatively high attribute scores for “walking” and “running,” and isestimated to frequently act with high calorie consumption.

Setting such a generating condition makes a difference between the userA and the user B in terms of “whether to frequently have exercise,”although there is no apparent difference as a whole because both of theuser A and the user B are “persons who chiefly work at a job.” Forexample, when the user B is confident that the user B frequently hasexercise and the user B would like to express the user B himself, whofrequently have exercise, in an object such as an avatar in virtualspace, the user B may simply set the “exercise filter” via the attributeselecting unit 172.

Additionally, even if such a filter-type generating condition is set, anattribute score that has not selected by the filter may be reflected onthe generation of an object to some extent. For example, the avatars1101 f and 1101 g do not necessarily have to put on training wears inthe example of FIG. 5, but may be in suits on the basis of the factthat, for example, “workplace” has the highest attribute score among theattribute scores that have not selected.

FIG. 6 is a diagram illustrating a second example in which an objectgenerating condition is set in the first embodiment of the presentdisclosure. A generating condition that can be also referred to as“shopping filter” is set in the illustrated example in order to generatean object on the basis of data as illustrated in FIG. 4. Morespecifically, the attribute selecting unit 172 selects attribute scoresfor “department store,” “supermarket,” and “bookstore,” which relate tohow the users do shopping, as attribute scores to be emphasized forgenerating an object.

As in the example of FIG. 5, the object generating unit 162 generates anobject on the basis of the selected attribute score. Thus, an avatar1101 h of a woman who is well dressed and has a shopping bag of thedepartment store is generated as an object for the user E, who has ahigh attribute score for “department store” in the illustrated example.Meanwhile, an avatar 1101 i of a woman who is casually dressed and has aplastic bag from which a green onion pokes up is set as an object forthe user F, who has a high attribute score for “supermarket.”

Setting such a generating condition makes a difference between the userE and the user F in terms of “where to do shopping,” although there isno apparent difference as a whole because both of the user E and theuser F are “housewives who are chiefly at home.” For example, when theiravatars are displayed in a site to which reviews for products areposted, the attribute selecting unit 172 automatically sets a “shoppingfilter” in accordance with an attribute of the site, which allowsreviews to be viewed by showing where users who have posted the reviewfrequently do shopping.

FIG. 7 is a diagram illustrating a third example in which an objectgenerating condition is set in the first embodiment of the presentdisclosure. A generating condition that can be also referred to as“weekend filter” is set in the illustrated example in order to generatean object on the basis of data as illustrated in FIG. 4. Morespecifically, the time frame selecting unit 170 selects “weekend” as atime frame in which an action history is emphasized for generating anobject. The figure illustrates attribute scores for “home,” “movement,”and “place other than home,” which are calculated for “weekend.” Theseattribute scores are calculated, for example, in accordance with thelength of a time for which positional information on a user issatisfying a condition for each attribute. In addition, these scores arealso normalized, and can be compared with each other.

The object generating unit 162 generates an object on the basis of anattribute score calculated on the basis of action history information inthe selected time frame in the illustrated example. In this case, forexample, an avatar 1101 j of a woman who has a travelling bag isgenerated as an object for the user C, who is at a “place other thanhome” for a long time. Meanwhile, an avatar 1101 k of a woman who isdrinking tea at home is generated as an object for the user D, who is at“home” for a long time.

Setting such a generating condition makes a difference between the userC and the user D in terms of a “way to spend a weekend,” although thereis no difference between attribute data in all of the time framesillustrated in FIG. 4. A large number of users who do work at a jobbasically work on weekdays, so that the individuality does not tend toappear in terms of a way to spend time. Accordingly, if the “weekendfilter” is set to generate objects, a variety of objects may begenerated for the respective users.

FIG. 8 is a diagram illustrating a modified example of the example ofFIG. 7. Attribute scores calculated in accordance with a condition for atime frame as illustrated in the example of FIG. 7 may be compared withattribute scores calculated without any condition for a time frame asillustrated in the example of FIG. 4 or attribute scores calculated inaccordance with a different condition in the present embodiment. In theillustrated example, the object generating unit 162 compares the highestattribute score (55) for “work” among the attribute scores calculatedwithout any condition for a time frame with the highest attribute score(80) for “home” among the attribute scores calculated only in a timeframe “weekend” for the user D illustrated in the examples of FIGS. 4and 7, and generates an object in accordance with the higher attributescore. As a result, an avatar 1101 k is generated as an object on thebasis of the attribute score for “home” calculated for “weekend” for theuser D.

For example, the most featured attribute score among the attributescores of a user calculated in different target time frames may beselected through this comparison. For example, if the user D has nofeature in particular about a way to spend weekends, but works harder onweekdays than anyone else, an avatar 1101 d that is generated on thebasis of an attribute score for “workplace” on weekdays may be selectedirrespective of a “weekend filter.” Meanwhile, if the user D works likeothers on weekdays, but spends time at home on weekends more frequentlythan anyone else, an avatar 1101 k that is generated on the basis of anattribute score for “home” on weekends may be selected.

Such comparison may be carried out in accordance with a condition thatis, for example, set by the time frame selecting unit 170 and theattribute selecting unit 172. Alternatively, the attribute scorecalculating unit 158 may attempt to calculate attribute scores inaccordance with a variety of filtering patterns of time frames andattributes, thereby searching for a generating condition that canreflect the personality of a user on an object the most appropriately.The generating condition may be different for each user, for example.

(1-5. Example of Setting Object Step by Step)

FIG. 9 is a diagram illustrating an example of setting an object step bystep in the first embodiment of the present disclosure. FIG. 9illustrates an example of information that may be stored in the objectDB 164 in the present embodiment. As discussed above, the object DB 164may store information on a plurality of objects set in accordance withattribute scores for the same attribute, and the object generating unit162 may select information on an appropriate object among them inaccordance with attribute scores of users. For example, this makes itpossible to express to what extent the items indicated by the attributesare applicable to the users. Additionally, the example illustrated inFIG. 9 does not correlate with the examples of FIGS. 4 to 8.

Information on objects are set step by step for three attributes “work,”“shopping,” and “train travel” in accordance with attribute scores inthe illustrated example. For example, when the attribute “work” is set(e.g. an attribute score is set in accordance with a time for which auser stays at a workplace), attribute scores of 50 to 59 cause an avatarto wear a necktie. Attribute scores of 60 to 69 further cause an avatarto wear a suit. Attribute scores of 70 to 99 cause an avatar to sweat inorder to express that the user is a hard worker. Furthermore, anattribute score of 100 causes a halo to shine around an avatar in orderto indicate that the user is a very hard worker and a great person.

In the same way, when the attribute “shopping” is set (e.g. an attributescore is set in accordance with a time for which a user stays in adepartment store), an avatar carries more shopping bags with an increasein an attribute score. Furthermore, the building of the department storeappears in the background, and the avatar is finally accompanied by anattendant who carries baggage for the avatar. When the attribute “traintravel” is set (e.g. an attribute score is set in accordance with a timefor which a user is moving on the train), an avatar is provided withitems that most rail-fans have one after another with an increase in anattribute score. Additionally, there may be pieces of information on anobject set at each step of an attribute score. For example, pieces ofinformation on an object may be set at each step of attribution scores.In this case, it may be decided, for example, on the basis of anoperation of a user which of objects the user selects at thecorresponding step of attribute scores.

In this way, in addition to qualitative information on what attributethe user has, generating an object that changes step by step inaccordance with attribute scores can reflect, on an object, quantitativeinformation on how strong the attribute of the user is. In addition, asdescribed in the example, if an object generated in accordance withattribute scores has play to some extent, an actual action of a user maybe motivated (e.g. “I am busy this week after all, so I will work harduntil a halo shines around the avatar,” etc.).

As a modified example that has a similar property to the property of theabove-described example, an attribute indicating whether a user hasachieved a predetermined event is defined in the attribute DB 160. Inthis case, the attribute score calculating unit 158 determines whetherthe user has achieved the event, on the basis of action historyinformation. For example, if the user has achieved the event, anattribute score is set to 1, and if not, an attribute score is set to 0.Furthermore, the object generating unit 162 may generate a specialobject indicating that an event has been achieved for a user for whom anattribute score of 1 is set for the attribute on the basis ofinformation stored in the object DB 164.

Examples of events include “a moving distance in a day reaches just 30km,” “a user is the first to come in the company in the morning in threestraight days,” “a user does shopping in a store a hundred times ormore,” “a user passes by a store once a day or more while the store isopen,” “a user acts in a certain way at certain time on a certain day(e.g. a user is on the twelfth floor of a building at 12:12 on Dec. 12,2012),” and “a user used to visit a certain store a year or more before,but has not visited the store for the last year.” These events andobjects corresponding to the events may be, for example, set for userssimply for fun, or may be used for marketing in combination withembodiments for displaying the objects on a map, which will be discussedbelow.

(1-6. Modified Examples for Functional Configuration)

FIG. 10 is a block diagram illustrating a first modified example of afunctional configuration in the first embodiment of the presentdisclosure. FIG. 10 illustrates that a system 20 includes a client 100,an action recognizing server 240, and an object server 250. The client100, the action recognizing server 240, and the object server 250 areconnected to each other via a variety of wired or wireless networks, andcommunicate with each other as needed.

Here, the client 100 includes the same functional configuration as thefunctional configuration of the client 100 in the system 10. The actionrecognizing server 240 includes an action recognizing unit 152, anaction history DB 154, and a communication unit 268 (identical to thecommunication unit 168 described with reference to FIG. 1). The objectserver 250 includes an action history acquiring unit 156, an attributescore calculating unit 158, an attribute DB 160, an object generatingunit 162, an object DB 164, a user DB 166, and a communication unit 168,and additionally includes one or both of a time frame selecting unit 170and an attribute selecting unit 172.

As illustrated in this example, the action recognizing server 240 andthe object server 250 are two servers that distribute and implement thefunction of the server 150 in the example of FIG. 1. As discussed above,the server 150 is implemented as a single information processing deviceor a plurality of information processing devices that operate incooperation with each other, so that the action recognizing server 240and the object server 250 can also be regarded as an example of theserver 150, which is implemented as a plurality of informationprocessing devices that operate in cooperation with each other. Needlessto say, the action recognizing server 240 and the object server 250 mayalso be each implemented as a plurality of information processingdevices that operate in cooperation with each other. In addition, theserver 150 may be distributed and implemented as a plurality ofinformation processing devices in a different form from the formillustrated in FIG. 10.

FIG. 11 is a block diagram illustrating a second modified example of thefunctional configuration in the first embodiment of the presentdisclosure. FIG. 11 illustrates that a system 30 includes a client 300and an object server 250. The client 300 and the object server 250 areconnected to each other via a variety of wired or wireless networks, andcommunicate with each other as needed.

Here, the client 300 includes an action recognizing unit 152 and anaction history DB 154 in addition to the functional configuration of theclient 100 in the system 10. The object server 250 includes the samefunctional configuration as the functional configuration of the objectserver 250 described with reference to FIG. 10.

As illustrated in the figure, the action recognizing unit 152 and theaction history DB 154 are incorporated into the client in the presentmodified example. For example, the client 300 may recognize an action ofa user with the action recognizing unit 152 on the basis of a resultsensing by an acceleration sensor or the like included in a sensing unit102, and accumulate the result in an action history DB 154. In thiscase, the object server 250 acquires action history information in apredetermined time frame by accessing the action history DB 154 of theclient 300, for example, regularly or when the client 300 requests anobject that represents a user to be generated.

In this way, the functional configuration of the system according to thepresent embodiment may be disposed on any element on a networkirrespective of a server or a client. Regarding this point, a variety ofmodified examples other than the above-described two modified examplescan be implemented. For example, as in the two modified examples, if anaction history acquiring unit 156 of the object server 250 is capable ofacquiring action history information from an external action history DB154, a provider that provides the object server 250 can acquire actionhistory information with the action recognizing server 240 or the client300 from another provider that provides an action recognizing service.In addition, action history information acquired through a plurality ofaction recognizing services may be merged and used. For example, aprovider that provides the object server 250 may also provide an actionrecognizing service (consequently, the object server 250 may have afunctional configuration as described for the server 150 illustrated inFIG. 1), further acquire action history information acquired through anaction recognizing service of another provider, and use the acquiredaction history information for calculating an attribute score andgenerating an object.

2. Second Embodiment

Next, a second embodiment of the present disclosure will be describedwith reference to FIGS. 12 and 13. This second embodiment is differentfrom the first embodiment in that an object representing a user is anobject to be superimposed on an actual image of the user. Additionally,the others such as the functional configuration are the same as those ofthe first embodiment, so that the repeated detailed description will beomitted.

FIG. 12 is a diagram illustrating a first display example in the secondembodiment of the present disclosure. An object 2101 generated by theobject generating unit 162 of the server 150 is superimposed on anactual image 2103 of a user in the present embodiment. A male user whois in a suit is displayed as the actual image 2103, and an object 2101of a straw hat is superimposed thereon in the illustrated example. Theobject 2101 may, for example, indicate that the user is now in a suiteand works at a job, but the user is busy in a kitchen garden onweekends. In this way, objects are not limited to avatars displayed invirtual space, but may be objects of clothing, accessories, hair styles,pets, and the like displayed along with an actual image of a user.

Here, the actual image 2103 of a user is visually recognized, forexample, as an image obtained by shooting an image of real spaceprovided in an AR application or the like, and an image of real spaceseen through a see-through display unit. The object generating unit 162or the display control unit 106 of the client 100 recognizes theposition and posture of the actual image 2103 of a user, and displaysthe object 2101 in accordance with them. Additionally, when such displayis performed, a user for whom an object is generated may be differentfrom a user who observes the displayed object.

FIG. 13 is a diagram illustrating a second display example in the secondembodiment of the present disclosure. As with the example of FIG. 12, amale user who is in a suit is displayed as an actual image 2103 in theillustrated example. An object 2105 is, for example, an environmentalobject that displays the background of the actual image, and the displayof the object 2105 hides the actual image 2103 of the user. The object2105 may be generated on the basis of an attribute score when it isindicated that the user does not satisfy a predetermined condition. Forexample, when a user who views the image sets a condition “person whofrequently does sports,” a user for whom an attribute score indicatesthat the user does not frequently do sports superimposes the object 2105to disappear from the sight of the user who views the image.

For example, when a user searches for a partner user to address in anevent site where a large number of users gather, such display iseffective in recognizing which user satisfies the desired condition tofacilitate communication after addressing the user. Even in this case,it can be said that the object 2105 reflects the personality of the userthat the user does not satisfy a predetermined condition.

3. Third Embodiment

Next, a third embodiment of the present disclosure will be describedwith reference to FIGS. 14 to 19. This third embodiment is differentfrom the first embodiment in that an object representing a user isdisplayed on a map, and it is possible to execute some function on thatdisplay. Additionally, the others are the same as those of the firstembodiment, so that the repeated detailed description will be omitted.

(3-1. Functional Configuration)

FIG. 14 is a block diagram illustrating a schematic functionalconfiguration of a system according to a third embodiment of the presentdisclosure. FIG. 14 illustrates that a system 40 includes a client 400and a server 450. The client 400 and the server 450 are connected toeach other via a variety of wired or wireless networks, and communicatewith each other as needed. The configuration of each of the client 400and the server 450 will be further described below.

(Client)

The client 400 is different from the client 100 described with referenceto FIG. 1 in that the client 400 does not include any sensing unit 102,but is the same as the client 100 in the other respects. The client 400does not transmit a result of sensing to the server, and is used mainlyby a user who observes an image including an object generated foranother user. Accordingly, the client 400 includes an input unit 104, adisplay control unit 106, and a display unit 108. The detaileddescription for this functional configuration will be omitted becausethe client 100 has also the same functional configuration.

(Server)

The server 450 is different from the server 150 described with referenceto FIG. 1 in that the server 450 includes an operation acquiring unit474 and a message transmitting unit 476, but is the same as the server150 in the other respects. The server 450 may include one or both of atime period selecting unit 170 and an attribute selecting unit 172,which is not, however, illustrated in the figure.

Since the client 400 does not transmits a result of sensing to theserver in the illustrated example, an action recognizing unit 152 of theserver 450 recognizes, on the basis of information from other clientsdifferent from the client 400, an action of a user who uses the otherclients. Thus, action history information stored in an action history DB154 is action history information on a user different from the client400, and an object generated through processes of an action historyacquiring unit 156, an attribute score calculating unit 158, and anobject generating unit 162 represents a user different from a user ofthe client 400.

That is to say, an object generated for another user in the server 450is displayed on the client 400, and the system 40 is a system for a userof the client 400 to execute some operation on the display. Thefunctions of the operation acquiring unit 474 and the messagetransmitting unit 476 included in the server 450 in the system 40 willbe further described below. Additionally, both of the operationacquiring unit 474 and the message transmitting unit 476 areimplemented, for example, by a CPU operating in accordance with aprogram stored in a memory.

The operation acquiring unit 474 receives information from the inputunit 104, which has acquired an operation of a user in the client 400,via a communication unit 168. The information received here may, forexample, be information indicating an operation of specifying at least apart of objects (objects generated by the object generating unit 162)displayed on a map, as shown in an example discussed below. The type ofobject to be specified may further be specified in this operationinformation. The operation acquiring unit 474 provides the acquiredinformation to the message transmitting unit 476. In addition, theoperation acquiring unit 474 may acquire a request for displaying anobject on a map. This request may include, for example, the type ofobject to be displayed, positional information on the client 400, andthe like. This information may be provided to the object generating unit162.

The message transmitting unit 476 is an example of a functional unitthat executes a predetermined function in accordance with informationacquired from the operation acquiring unit 474. The message transmittingunit 476 transmits a message to a user corresponding to an object on amap in the illustrated example, the object being specified in accordancewith the operation information acquired by the operation acquiring unit474. A destination to which the message is transmitted may be at least apart of clients that has provided information for recognizing an action,for example, to the action recognizing unit 152. The messagetransmitting unit 476 may reference a user DB 166 in order to acquireinformation on a destination to which the message is transmitted.

(3-2. Example of Process)

FIG. 15 is a diagram illustrating an example of data used in the thirdembodiment of the present disclosure. The illustrated data may bestored, for example, in the user DB 166 in the server 450. This dataincludes items “object type,” “present position,” and “E-mail” forrespective users (users A to D). “Object type” has the type of objectrecorded thereon, the object being generated by the object generatingunit 162 and associated with each user. “Present position” haspositional information on each user recorded thereon, for example, in alatitudinal and longitudinal form, the positional information beingdetected with a GPS and the like. “E-mail” has an e-mail addressrecorded thereon, the e-mail address being, for example, registered byeach user for use of a service.

An object type “businessperson” (e.g. a type of object generated for auser having a relatively high attribute score for work) is recorded fora user A and a user D, an object type “gorgeous” (e.g. a type of objectgenerated for a user having a relatively high attribute score for luxuryshopping) is recorded for a user B, and an object type “sportsperson”(e.g. a type of object generated for a user having a relatively highattribute score for sports) is recorded for a user C in the illustratedexample. Additionally, these object types may be decided, for example,on the basis of all of the attribute scores for the users, or decided asa result after a user sets some condition with the time frame selectingunit 170, the attribute selecting unit 172, or the like.

FIG. 16 is a flowchart illustrating an example of a process in the thirdembodiment of the present disclosure. First of all, the objectgenerating unit 162 regularly updates object information on a userstored in the user DB 166 on the basis of an attribute score calculatedby the attribute score calculating unit 158 in the server 450 (stepS201). This also updates, for example, the items in “object type”illustrated in FIG. 15. Here, when the client 400 requests an object tobe displayed (step S203), a process for displaying the object isexecuted in the server 450.

An object is generated by the object generating unit 162 in advance, andobject information is stored in the user DB 166 in the presentembodiment. Thus, a process for displaying an object begins with aprocess for the object generating unit 162 to select which user's objectis displayed on the basis of information on an object type stored in theuser DB 166 (step S207), if there is a choice of an object type to bedisplayed in response to the display request (step S205). As in theexample of FIG. 3, a process may be executed for the attribute scorecalculating unit 158 to calculate an attribute score or to read out anattribute score, and furthermore, a process may be executed for theaction history acquiring unit 156 to acquire an action history in theother embodiments.

Next, the object generating unit 162 extracts an object to be displayedon the basis of positional information on the client 400 included in thedisplay request (step S209). The object extracted here is limited to anobject of a target type, when a type of object was selected in stepS207. Otherwise, an object is extracted irrespective of the type.

Next, the object generating unit 162 maps the extracted object to a mapon the basis of positional information on the corresponding user storedin the user DB 166 (step S211), and transmits information on the map towhich the object has been mapped to the client 400 (step S213). Here,the map to which an object is mapped is set on the basis of thepositional information on the client 400 included in the displayrequest.

(3-3. Display Example)

FIG. 17 is a diagram illustrating a first display example in the thirdembodiment of the present disclosure. The display unit 108 of the client400 displays objects 3101 representing users on a map 3100 in theillustrated example. Here, the colors of the objects 3101 change inaccordance with attribute scores of the users. That is to say, objectsdifferent in color are generated for an object 3101 a (object of objecttype “walking”) of a user for which a score for “walking” is calculatedas an attribute score indicating the current action, and an object 3101b (object of object type “train”) of a user for which a score for“train” is calculated in the same way, and an object 3101 c (object ofobject type “car”) of a user for which a score for “car” is calculatedin the same way. As illustrated in the figure, the objects generated inthis example has an abstract figure or circle, and even in this case, itis possible to display information (what means is used for movement inthis case) on the personalities of the users by changing the colors, forexample, in accordance with the attribute scores.

FIG. 18 is a diagram illustrating a second display example in the thirdembodiment of the present disclosure. When the client 400 displaysobjects 3101 on a map 3100 in the illustrated example as in the exampleof FIG. 17, a touch panel or the like included in the input unit 104 isused to input a range specifying FIG. 3103. In addition, to specify atarget object type, selecting check boxes 3105 are displayed on a legendof objects, which allows for the selection with the input unit 104. Auser positioned around the center of the map 3100 is specified by therange specifying FIG. 3103, and the check box 3105 limits targets tousers who are displayed with an object type “walking” in, theillustrated example. This makes it possible, for example, to execute anoperation such as delivering messages only to users who are positionedwithin a specified area and have a specified attribute.

The operation acquiring unit 474 then acquires information on anoperation of a user which is displayed by depiction of the rangespecifying FIG. 3103 and selection of the check box 3105, and themessage transmitting unit 476 executes a function such as transmitting amessage in the server 450. Here, the message transmitting unit 476, forexample, compares “present position” in the data illustrated in FIG. 15with an area indicated by the range specifying FIG. 3103 on the map 3100to extract a user who satisfies a positional condition. Furthermore, themessage transmitting unit 476 compares “object type” with an object typespecified by the check box 3105 to extract a user who satisfies acondition of an object type, and transmits a message to the addressdisplayed as “E-mail” of the extracted user.

The above-described configuration, for example, makes it possible toextract a user having a certain attribute (indicated by an object type)from users at a certain place, and transmit a message to the extracteduser with an intuitive and easy operation. Additionally, two or moreattributes may be set. For example, when all the users for whom objectsare displayed are limited to users who are “office worker” (limitationbased on a first attribute) in the example of FIG. 18, an area near thestation is further specified (limitation based on positionalinformation) for the users, the users are further limited to users whoare moving on foot (limitation based on a second attribute), andmessages are transmitted to the limited users, which allows, forexample, advertisement for lunches of a restaurant to be delivered onlyto users who are estimated as buyers.

(3-4. Modified Example)

FIG. 19 is a block diagram illustrating a schematic functionalconfiguration of a system according to a modified example of the thirdembodiment of the present disclosure. FIG. 19 illustrates that a system42 includes a client 400 and a server 450. The configuration of thesystem 42 is basically the same as the configuration of the system 40according to the present embodiment described with reference to FIG. 14,but different therefrom in that the system 42 includes a postingreception unit 478 instead of the message transmitting unit 476 as afunctional unit of the server 450.

The posting reception unit 478 is an example of a functional unit thatexecutes a predetermined function in accordance with informationacquired from an operation acquiring unit 474. The posting receptionunit 478 receives a posting from a user on the basis of operationinformation acquired by the operation acquiring unit 474, and referencesobject information stored in a user DB 166 to determine whether the useris qualified for posting in the illustrated example. When a user isqualified for posting, the posting reception unit 478 transmits an inputscreen for posting to the client 400 via a communication unit 168. Theposting reception unit 478 is implemented, for example, by a CPUoperating in accordance with a program stored in a memory.

FIG. 20 is a flowchart illustrating a modified example of the thirdembodiment of the present disclosure. First of all, an object generatingunit 162 regularly updates object information stored in the user DB 166on the basis of an attribute score calculated by an attribute scorecalculating unit 158 in the server 450 (step S301). This also updates,for example, the items in “object type” illustrated in FIG. 15. Here,when the client 400 makes a review posting request (step S303), aprocess for making a determination on the basis of an object type isexecuted in the server 450. Additionally, the review means hereinformation such as an evaluation of a restaurant or the like providedfrom a user who has used the restaurant.

Here, the posting reception unit 478 determines whether a user who hastransmitted a review posting request is associated with a predeterminedobject type (step S305). This determination may be made, for example, onthe basis of object information stored in the user DB 166 for an objectgenerated by the object generating unit 162 in advance. Alternatively,when a determination is made, the object generating unit 162 maygenerate an object on the basis of an attribute score and adetermination may be made on the basis of the type of that object.Additionally, the predetermined object type is, for example, set inadvance for each review posting target store or each community for whicha review is displayed.

In step S305, when a user is associated with a predetermined objectattribute, the posting reception unit 478 further references the user DB166 to determine whether positional information on the user indicates anarea around a review posting target store (step S307). Here, when it isdetermined that the positional information on the user indicates an areaaround the store, the posting reception unit 478 transmits a reviewposting screen to the client 400 via the communication unit 168 (stepS309). To the contrary, when a negative determination is made in stepS305 or step S307, the posting reception unit 478 transmits a messageindicating that it is not possible to receive a review posting (postingdisabled message) to the client 400 via the communication unit 168 (stepS311).

These processes allow, for example, users who post reviews about a storeto be limited to users having a specific attribute (such as ladies onlyand adults only). For example, when a store sets a target group of thestore, or when reviews are shown in a community that targets usershaving a specific attribute, such limitation may be effective. Inaddition, if the positions of users are limited to an area around astore, only reviews made by actual users of the store immediately afterusing the store can be received. For example, when it is desired toexclude shills or to make much of the freshness of reviews, suchlimitation may be effective.

4. Fourth Embodiment

Next, a fourth embodiment of the present disclosure will be describedwith reference to FIGS. 21 to 24. This fourth embodiment is differentfrom the second embodiment in terms of display and sharing of agenerated object. Additionally, others such as the functionalconfiguration are the same as those of the second embodiment, so thatthe repeated detailed description will be omitted.

FIG. 21 is a diagram illustrating a first display example in the fourthembodiment of the present disclosure. An object superimposed on anactual image of a user is shared among a plurality of users in thepresent embodiment. That is to say, the history acquiring unit 156 ofthe server 150 acquires action history information for a plurality ofusers, the attribute score calculating unit 158 calculates attributescores for a plurality of users, and the object generating unit 162generates an object that is visually recognizable to each of users.

As an example, it is conceivable that each user acts with a head mounteddisplay that is, for example, disclosed in JP 2008-83290A and canvisually recognize the outside, and when the user sees another user, anobject is superimposed on the user. A male user looking healthy isdisplayed as an actual image 4103, and an object 4101 of a man lookingunhealthy is superimposed thereon in the illustrated example. The object4101 may indicate, for example, that the user actually leads anunhealthy life. The display of the object 4101 reveals to other usersthat the user leads an unhealthy life.

In this way, an object may function as an avatar (copy) indicating astate of a user that is not visually apparent. In this case, forexample, a user can be motivated to improve an actual action of the usersuch as leading a healthier life in order to make an avatar viewed byother users look better. Communication among users may be made moreactive by allowing avatars to be displayed to limited users and allowingevaluations such as comments on avatars to be transmitted. If usersthemselves can visually recognize avatars, the users can feel as if theusers were virtually accompanied by the avatars. Accordingly, the usersdo not necessary have to share the display of an avatar with other usersto enjoy themselves in some cases.

Additionally, a displayed avatar may be a literal “copy” that is thesame sex and age as a user, may also be the different sex from a user,and may be not a human but an animal. For example, a male user may beaccompanied by an avatar of a woman as a virtual girlfriend, or may alsobe accompanied by an avatar of an animal like a pet. However, even inthis case, an action of a user himself or herself is reflected on anappearance of an avatar. For example, when a male user is accompanied bya girlfriend as an avatar, an unhealthy life of the user makes thegirlfriend look unhealthy. In addition, when a user is accompanied by apet as an avatar, an unhealthy life of the user makes the pet lookdirty. In this way, even when an avatar is not necessarily displayed asa literal “copy” of a user, the avatar reflects the personality of theuser and may, for example, advantageously motivate the user to improvehis or her action or look friendly.

FIG. 22 is a diagram illustrating an example of a process of sharing thedisplay of an object in friend registration between users in the fourthembodiment of the present disclosure. First of all, a terminal A used bya user A transmits a friend request (step S401). A terminal B used by auser B receives this friend request (step S403), and determines whetherto approve the friend request, for example, on the basis of an operationof the user B (step S405). Here, if the friend request is not approved,a non-approval reply is returned to the terminal A (step S407), and thenthe processes terminate.

To the contrary, if the friend request is approved in step S405, theterminal B transmits an approval reply (step S409). After receiving theapproval reply (step S411), the terminal A transmits object informationon the user A to the terminal B (step S413). The object informationtransmitted here has been generated, for example, by the objectgenerating unit 162 of the server 150 as in the second embodiment, andtransmitted to the terminal A. The object information received from theserver 150 is stored in the terminal A, and the stored objectinformation is transmitted in step S413.

Here, the terminal B receives and stores the object information on theuser A (step S415). Next, the terminal B transmits object information onthe user B to the terminal A (step S417). The terminal A receives andstores the object information on the user B (step S419). This allows theterminal A and the terminal B to share the object information on both ofthe terminals A and B. The terminal A will be able to superimpose anobject of the user B on an actual image of the user B below (step S421),while the terminal B will be able to superimpose an object of the user Aon an actual image of the user A (step S423). Additionally, let usassume that it is possible for both of the terminal A and the terminal Bto recognize the faces of the user A and the user B on the basis ofinformation exchanged in advance. When a change in an action history ofeach user updates the object after these processes, the object may betransmitted again (step S413 or step S417).

Additionally, FIG. 22 has described an example of a peer to peer (P2P)system in which terminals communicate with each other via no server, butthe display of an object may be shared between users throughcommunication via a server. In this case, each terminal device does nothave to store an object, and all the terminal has to do is to add eachother to each object display target stored in the server (e.g. when theuser B is a first friend to the user A, the user B is set to the objectdisplay target of the user A in addition to the user A (himself orherself) and both of the terminal A and the terminal B can display theobject).

FIG. 23 is a diagram illustrating a second display example in the fourthembodiment of the present disclosure. An objects corresponding to eachuser fights for the user in the illustrated example. An object 5101 a isan avatar of a user A, while an object 5101 b is an avatar of a user B.A screen 5100 a of the user A displays an image showing these objects5101 standing on a notebook PC used as a prize ring from the perspectiveof the object 5101 a, while a screen 5100 b of the user B displays animage showing the same situation from the perspective of the object 5101b. Different from the example of FIG. 21, the objects 5101 are notsuperimposed on the images of the users. For example, such a performancemay be conducted that an avatar which usually sits on a shoulder of auser as in the example of FIG. 21 gets off the shoulder to fight againstan opponent once a fight begins.

In that example, a parameter (fighting parameter) for function for sucha fight may be set for an object (avatar) generated by the objectgenerating unit 162 of the server 150. A fighting parameter may be seton the basis of an attribute score common to both of the users. Forexample, a fighting parameter may be set in accordance with the“exercise filter” in the example of FIG. 5. In this case, for example,users who more frequently act with high calorie consumption have higherfighting parameters such as intelligence, stamina, discernment,concentration, and luck. Thus, users who train themselves on a dailybasis may have advantage in fights using avatars.

Alternatively, a fighting parameter may be set on the basis of anattribute score set by each user with a filter and the like. In thiscase, for example, each user can specify a filter for an attribute atwhich the user is good, generate an avatar, and then begin a fight. Forexample, the user A sets a fighting parameter in accordance with the“exercise filter”, while the user B may set a fighting parameter inaccordance with the “shopping filter.” in this case, it is not true thatan avatar of a user who has physical strength constantly wins a fight,but a user having a remarkable attribute score for some attribute winsin some cases.

In addition, a fighting parameter may be reflected on an appearance ofan avatar or not. For example, a generating condition used forgenerating an appearance of an avatar may be different from a generatingcondition used for generating a fighting parameter set for the avatar.In this case, a fight having game elements increased by such a gapbetween appearance and strength is conducted that an avatar of aprofessional baseball player whose hobby is, for example, fishing doesnot look very strong because a filter “way to spend a leisure time” isset for an appearance of the avatar, but the avatar is excessivelystrong because the “exercise filter” is set for a fighting parameter.

FIG. 24 is a flowchart illustrating an example of a process forimplementing display as illustrated in FIG. 23. A terminal A and aterminal B are used by a user A and a user B, respectively, in theillustrated example. A server may have a function of generating anobject like the server 150 in the above-described examples, or may alsobe a different server prepared for a fighting game. In the former case,the server includes a structural element that controls a fighting gameas a functional unit to execute a predetermined function in the same wayas the message transmitting unit 476, for example, in the thirdembodiment. In the latter case, the server acquires object informationgenerated by the object generating unit 162 from the server 150 inadvance.

First of all, as a step of preparing for a fight, a fighting parameteris set in the server on the basis of object information on each user(step S501). The terminal A and the terminal B then transmit an attackcommand (step S503) and a defense command (step S505), respectively. Afighting 3D graphic image is generated in the server on the basis of thetransmitted attack and defense commands (step S507).

Next, each of the terminal A and the terminal B transmits a capturedimage indicating the position, a three-dimensional direction, a zoomfactor, and the like of a terminal camera (steps S509 and S511). Theserver, which receives these captured images, compares the capturedimages to identify a reference point substantially at the center of thescreen among the corresponding feature points (step S513). Next, theserver generates 3D graphic images around the reference point on a planein view of a positional relationship between the respective cameras(step S515), and delivers the different 3D graphic images to theterminal A and the terminal B (step S517).

Next, each of the terminal A and the terminal B displays the 3D graphicimage delivered to the terminal (steps S519 and S521). When theviewpoint of each terminal changes, the processes in steps S509 to S521are repeated. Thereafter, an attack side is exchanged with a defenseside as a next turn operation, the terminal A transmits a defensecommand (step S523), and the terminal B transmits an attack command(step S525). The same processes will be repeated thereafter.

Additionally, the processes are examples, and other various fightinggames are possible in an embodiment of the present disclosure. Forexample, an image for a fighting game does not necessarily have to be a3D image, or a game may proceed without an attack command or a defensecommand. In addition, any game other than a fighting game is alsopossible, and a game may be played by a single user. Even in this case,a user can enjoy himself or herself in the same way as the fighting gameby operating a player character generated on the basis of an attributescore of him or her.

In addition, an example in which objects such as avatars aresuperimposed on actual images of users has been described in the presentembodiment, but avatars may be displayed on a screen for an applicationin another embodiment. Thus, an avatar does not necessarily have to besuperimposed on actual space in a fighting game (or other games), and anavatar of a user may function as a player character on the same screenas a common 2D or 3D game screen.

5. Hardware Configuration

Next, a hardware configuration of an information processing deviceaccording to an embodiment of the present disclosure will be describedwith reference to FIG. 25. FIG. 25 is a block diagram for describing ahardware configuration of an information processing device. Anillustrated information processing device 900 may implement, forexample, the various servers and clients in the above-describedembodiments.

The information processing device 900 includes a central processing unit(CPU) 901, read only memory (ROM) 903, and random access memory (RAM)905. In addition, the information processing device 900 may include ahost bus 907, a bridge 909, an external bus 911, an interface 913, aninput device 915, an output device 917, a storage device 919, a drive921, a connection port 923, and a communication device 925. Further, theinformation processing device 900 may include an imaging device 933 anda sensor 935 as necessary. The information processing device 900 mayinclude a processing circuit such as a digital signal processor (DSP)instead of or in addition to the CPU 901.

The CPU 901 functions as an operation processor and a controller, andcontrols all or some operations in the information processing device 900in accordance with a variety of programs recorded on the ROM 903, theRAM 905, the storage device 919, or a removable recording medium 927.The ROM 903 stores a program, an operation parameter, and the like whichare used by the CPU 901. The RAM 905 primarily stores a program which isused in the execution of the CPU 901 and a parameter which isappropriately modified in the execution. The CPU 901, the ROM 903, andthe RAM 905 are connected to each other by the host bus 907 including aninternal bus such as a CPU bus. In addition, the host bus 907 isconnected to the external bus 911, such as a peripheral componentinterconnect/interface (PCI) bus via the bridge 909.

The input device 915 is a device which is operated by a user, such as amouse, a keyboard, a touch panel, a button, a switch, and a lever. Theinput device 915 may be, for example, a remote control device usinginfrared light or other radio waves, or may be an external connectiondevice 929 such as a mobile phone operable in response to the operationof the information processing device 900. The input device 915 includesan input control circuit which generates an input signal on the basis ofinformation input by a user and outputs the input signal to the CPU 901.By operating the input device 915, a user inputs various types of datato the information processing device 900 or requires a processingoperation.

The output device 917 includes a device capable of visually or audiblynotifying the user of acquired information. The output device 917 may bea display device (or may be a see-through display device or a headmounted display) such as a liquid crystal display (LCD), a plasmadisplay panel (PDP), and an organic electro-luminescence (EL) display,an audio output device such as a speaker and a headphone, a printerdevice, or the like. The output device 917 may output a result obtainedfrom the processing of the information processing device 900 in a formof a video such as text and an image, and an audio such as voice andsound.

The storage device 919 is a device for data storage which is configuredas an example of a storage unit of the information processing device900. The storage device 919 includes, for example, a magnetic storagedevice such as a hard disk drive (HDD), a semiconductor storage device,an optical storage device, or a magneto-optical storage device. Thestorage device 919 stores a program to be executed by the CPU 901,various types of data, various types of data acquired from the outside,and the like.

The drive 921 is a reader/writer for the removable recording medium 927such as a magnetic disk, an optical disc, a magneto-optical disk, and asemiconductor memory, and is built in the information processing device900 or externally attached thereto. The drive 921 reads out informationrecorded in the removable recording medium 927 attached thereto, andoutputs the read-out information to the RAM 905. Further, the drive 921writes record in the removable recording medium 927 attached thereto.

The connection port 923 is a port used to directly connect a device tothe information processing device 900. The connection port 923 mayinclude, for example, a universal serial bus (USB) port, an IEEE1394port, and a small computer system interface (SCSI) port. The connectionport 923 may further include an RS-232C port, an optical audio terminal,a high-definition multimedia interface (HDMI) port, and so on. Theconnection of the external connection device 929 to the connection port923 makes it possible to exchange various types of data between theinformation processing device 900 and the external connection device929.

The communication device 925 is, for example, a communication interfaceincluding a communication device or the like for a connection to acommunication network 931. The communication device 925 may be, forexample, a communication card for a wired or wireless local area network(LAN), Bluetooth (registered trademark), a wireless USB (WUSB) or thelike. In addition, the communication device 925 may be a router foroptical communication, a router for an asymmetric digital subscriberline (ADSL), a modem for various kinds of communication, or the like.The communication device 925 transmits a signal to and receives a signalfrom, for example, the Internet or other communication devices on thebasis of a predetermined protocol such as TCP/IP. In addition, thecommunication network 931 connected to the communication device 925 maybe a network connected in a wired or wireless manner, and is, forexample, the Internet, a home LAN, infrared communication, radio wavecommunication, satellite communication, or the like.

The imaging device 933 is a device that generates a captured image byshooting an image of real space using an image sensor such as a chargecoupled device (CCD) or complementary metal oxide semiconductor (CMOS),as well as various members such as a lens for controlling the formationof a subject image on the image sensor, for example. The imaging device933 may be a device that shoots a still image, and may also be a devicethat shoots a moving image.

The sensor 935 includes various sensors such as an acceleration sensor,a gyro sensor, a geomagnetic sensor, an optical sensor, and an audiosensor. The sensor 935 acquires information on a state of theinformation processing device 900, such as the posture of the case ofthe information processing device 900, and information on an environmentaround the information processing device 900, such as the brightness andnoise around the information processing device 900. The sensor 935 mayalso include a global positioning system (GPS) sensor that receives GPSsignals and measures the latitude, longitude, and altitude of thedevice.

The example of the hardware configuration of the information processingdevice 900 has been described so far. Each of the above-describedstructural elements may be configured using a general-purpose member,and may also be configured using hardware specialized in the function ofeach structural element. Such a configuration may also be modified asappropriate in accordance with the technological level at the time ofthe implementation.

6. Supplement

The embodiments of the present disclosure may include, for example, aninformation processing device (client and various servers) and a systemas described above, an information processing method executed by theinformation processing device or the system, a program for causing theinformation processing device to function, and a recording medium havingthe program recorded thereon.

Additionally, the various servers and clients in the above-describedembodiments do not necessarily have to be implemented as devices thatserve as servers or clients on a network. An embodiment of the presentdisclosure can be implemented, for example, by each terminal(information processing device) operating as a variety of servers orclients on a so-called mesh network.

The preferred embodiments of the present invention have been describedabove with reference to the accompanying drawings, whilst the presentinvention is not limited to the above examples, of course. A personskilled in the art may find various alterations and modifications withinthe scope of the appended claims, and it should be understood that theywill naturally come under the technical scope of the present invention.

Additionally, the present technology may also be configured as below.

(1)

An information processing device including:

an action history acquiring unit configured to acquire action historyinformation on a user, the action history information being accumulatedin a predetermined time frame;

an attribute score calculating unit configured to calculate an attributescore of the user for one or more attributes in an attribute group, theattribute score being based on the action history information; and

an object generating unit configured to generate an object on the basisof the attribute score, the object representing the user.

(2)

The information processing device according to (1), further including:

a condition setting unit configured to set a generating condition of theobject.

(3)

The information processing device according to (2),

wherein the condition setting unit includes an attribute selecting unitconfigured to select the attribute score to be emphasized for generatingthe object.

(4)

The information processing device according to (2) or (3),

wherein the condition setting unit includes a time frame selecting unitconfigured to select a time frame of the predetermined time frame to beemphasized for generating the object.

(5)

The information processing device according to any one of (2) to (4),

wherein the condition setting unit sets the generating condition inaccordance with an operation of the user.

(6)

The information processing device according to any one of (2) to (5),

wherein the condition setting unit sets the generating condition inaccordance with a situation in which the object is displayed.

(7)

The information processing device according to any one of (1) to (6),

wherein the attribute score calculating unit calculates the attributescores for a plurality of attributes in the attribute group, and

wherein the object generating unit selects a type of the object on thebasis of comparison among the attribute scores for the respectiveattributes.

(8)

The information processing device according to any one of (1) to (7),

wherein the attribute group includes an attribute indicating whether apredetermined event has been achieved.

(9)

The information processing device according to any one of (1) to (8),

wherein the object generating unit generates the object to besuperimposed on an actual image of the user.

(10)

The information processing device according to (9),

wherein the object generating unit generates the object for hiding theuser by displaying a background of the actual image of the user.

(11)

The information processing device according to any one of (1) to (10),

wherein the object generating unit generates the object that changesstep by step in accordance with the attribute scores.

(12)

The information processing device according to any one of (1) to (11),

wherein the object generating unit generates the object that changes acolor in accordance with the attribute scores.

(13)

The information processing device according to any one of (1) to (12),

wherein the object generating unit generates the object to be displayedon a map.

(14)

The information processing device according to (13), further including:

an operation acquiring unit configured to acquire information on anoperation for an observer of the objects displayed on the map to specifyat least a part of the objects; and

a functional unit configured to execute a predetermined function on theuser corresponding to the specified object.

(15)

The information processing device according to (14),

wherein the operation includes an operation of specifying an area on themap.

(16)

The information processing device according to any one of (1) to (15),

wherein the action history acquiring unit acquires the action historyinformation on a plurality of users,

wherein the attribute score calculating unit calculates the attributescores for the plurality of users, and

wherein the object generating unit generates the object that is visuallyrecognizable to each of the plurality of users.

(17)

An information processing device including:

a sensing unit configured to sense an action of a user;

a communication unit configured to transmit a result of the sensing to aserver, and to receive information on an object from the server, theobject being generated on the basis of an attribute score calculated forone or more attributes in an attribute group on the basis of actionhistory information on the user accumulated in a predetermined timeframe and representing the user, the action history information beinggenerated on the basis of information including the result of thesensing; and

a display control unit configured to cause a display unit to display theobject.

(18)

A system including:

a client; and

a server,

wherein the client includes

-   -   a sensing unit configured to sense an action of a user,    -   a communication unit configured to transmit a result of the        sensing to the server, and to receive information on an object        from the server, the object representing the user, and    -   a display control unit configured to cause a display unit to        display the object, and

wherein the server includes

-   -   an action history acquiring unit configured to acquire action        history information on the user, the action history information        being accumulated in a predetermined time frame and being        generated on the basis of information including the result of        the sensing,    -   an attribute score calculating unit configured to calculate an        attribute score of the user for one or more attributes in an        attribute group, the attribute score being based on the action        history information, and    -   an object generating unit configured to generate the object on        the basis of the attribute score.        (19)

An information processing method including:

acquiring action history information on a user, the action historyinformation being accumulated in a predetermined time frame;

calculating an attribute score of the user for one or more attributes inan attribute group, the attribute score being based on the actionhistory information; and

generating an object on the basis of the attribute score, the objectrepresenting the user.

(20)

A program for causing a computer to execute:

a function of acquiring action history information on a user, the actionhistory information being accumulated in a predetermined time frame;

a function of calculating an attribute score of the user for one or moreattributes in an attribute group, the attribute score being based on theaction history information; and

a function of generating an object on the basis of the attribute score,the object representing the user.

REFERENCE SIGNS LIST

-   10, 20, 30, 40, 42 system-   100, 300, 400 device-   102 sensing unit-   104 input unit-   106 display control unit-   108 display unit-   110 communication unit-   240 action recognizing server-   150, 250 server (object server)-   152 action recognizing unit-   156 action history acquiring unit-   158 attribute score calculating unit-   162 object generating unit-   168, 268 communication unit-   170 time frame selecting unit-   172 attribute selecting unit-   474 operation acquiring unit-   476 message transmitting unit-   478 posting reception unit

The invention claimed is:
 1. An information processing devicecomprising: circuitry configured to acquire action history informationfrom a plurality of users, the action history information including ageographical location of each user of the plurality of users and anactivity type of each user of the plurality of users in a predeterminedtime slot which is a series of a plurality of time frames, respectively;calculate one or more attribute scores of each user of the plurality ofusers, in accordance with the action history information; select atarget object type among one or more object types for each user, thetarget object type being determined by comparing the one or moreattribute scores of the user calculated in different time frames in theseries of the plurality of time frames, each of the one or more objecttypes indicating a respective feature of a current action of the user;extract a plurality of virtual objects each representing each user ofthe plurality of users, based on the target object type and thegeographical location of the action history information for therespective user; map the plurality of virtual objects on a geographicalmap, based on the geographical location of the action historyinformation for the respective user; specify at least one user from theplurality of users represented by one of the virtual objects on thegeographical map, by selecting respective virtual object of the at leastone user based on the current action and the geographical location onthe geographical map; and transmit a message to the specified user. 2.The information processing device according to claim 1, wherein thecircuitry is configured to set a generating condition of each virtualobject of the plurality of virtual objects.
 3. The informationprocessing device according to claim 2, wherein the circuitry isconfigured to select a certain time frame of the predetermined time slotto be emphasized for selecting the object type generating each virtualobject of the virtual objects.
 4. The information processing deviceaccording to claim 2, wherein the circuitry sets the generatingcondition in accordance with an operation by at least one of theplurality of users.
 5. The information processing device according toclaim 1, wherein at least one attribute score of the one or moreattribute scores includes an attribute indicating whether apredetermined event has been achieved.
 6. The information processingdevice according to claim 1, wherein the circuitry generates the virtualobjects that are visually recognizable to each of the plurality ofusers.
 7. The information processing device according to claim 1,wherein at least one of the attribute score of the one or more attributescores indicates at least one of walking, moving in a car and moving ina train.
 8. An information processing method comprising: acquiringaction history information from a plurality of users, the action historyinformation including a geographical location of each user of theplurality of users and an activity type of each user of the plurality ofusers in a predetermined time slot which is a series of a plurality oftime frames, respectively; calculating one or more attribute scores ofeach user of the plurality of users, in accordance with the actionhistory information; selecting a target object type among one or moreobject types for each user, the target object type being determined bycomparing the one or more attribute scores of the user calculated indifferent time frames in the series of the plurality of time frames,each of the one or more object types indicating a respective feature ofa current action of the user; extracting a plurality of virtual objectseach representing each user of the plurality of users, based on thetarget object type and the geographical location of the action historyinformation for the respective user; mapping the plurality of virtualobjects on a geographical map, based on the geographical location of theaction history information for the respective user, specifying at leastone user from the plurality of users represented by one of the virtualobjects on the geographical map, by selecting respective virtual objectof the at least one user based on the current action and thegeographical location on the geographical map; and transmitting amessage to the specified user.
 9. The information processing methodaccording to claim 8, further comprising: setting a generating conditionof each virtual object of the plurality of virtual objects.
 10. Theinformation processing method according to claim 9, further comprising:selecting a certain time frame of the predetermined time slot to beemphasized for generating each virtual object of the virtual objects.11. The information processing method according to claim 9, furthercomprising: setting the generating condition in accordance with anoperation by at least one of the plurality of users.
 12. The informationprocessing device according to claim 8, wherein at least one attributescore of the one or more attribute scores includes an attributeindicating whether a predetermined event has been achieved.
 13. Theinformation processing device according to claim 8, further comprising:generating the virtual objects that are visually recognizable to each ofthe plurality of users.
 14. The information processing device accordingto claim 8, wherein at least one of the attribute score of the one ormore attribute scores indicates at least one of walking, moving in a carand moving in a train.
 15. A non-transitory computer readable mediumhaving stored thereon a program that when executed by processingcircuitry of a computer causes the computer to implement an informationprocessing method comprising: acquiring action history information froma plurality of users, the action history information including ageographical location of each user of the plurality of users and anactivity type of each user of the plurality of users in a predeterminedtime slot which is a series of a plurality of time frames, respectively;calculating one or more attribute scores of each user of the pluralityof users, in accordance with the action history information; selecting atarget object type among one or more object types for each user, thetarget object type being determined by comparing the one or moreattribute scores of the user calculated in different time frames in theseries of the plurality of time frames, each of the one or more objecttypes indicating a respective feature of a current action of the user;extracting a plurality of virtual objects each representing each user ofthe plurality of users, based on the target object type and thegeographical location of the action history information for therespective user; mapping the plurality of virtual objects on ageographical map, based on the geographical location of the actionhistory information for the respective user, specifying at least oneuser from the plurality of users represented by one of the virtualobjects on the geographical map, by selecting respective virtual objectof the at least one user based on the current action and thegeographical location on the geographical map; and transmitting amessage to the specified user.
 16. The non-transitory computer readablemedium according to claim 15, wherein the method further comprisessetting a generating condition of each virtual object of the pluralityof virtual objects.
 17. The non-transitory computer readable mediumaccording to claim 16, wherein the method further comprises selecting acertain time frame of the predetermined time slot to be emphasized forgenerating each virtual object of the virtual objects.
 18. Thenon-transitory computer readable medium according to claim 16, whereinthe method further comprises setting the generating condition inaccordance with an operation by at least one of the plurality of users.19. The non-transitory computer readable medium according to claim 15,wherein at least one attribute score of the one or more attribute scoresincludes an attribute indicating whether a predetermined event has beenachieved.
 20. The non-transitory computer readable medium according toclaim 15, wherein the method further comprises generating the virtualobjects that are visually recognizable to each of the plurality ofusers.
 21. The non-transitory computer readable medium according toclaim 15, wherein at least one of the attribute score of the one or moreattribute scores indicates at least one of walking, moving in a car andmoving in a train.